Online Balanced Repartitioning
نویسندگان
چکیده
This paper initiates the study of a fundamental online problem called online balanced repartitioning. Unlike the classic graph partitioning problem, our input is an arbitrary sequence of communication requests between nodes, with patterns that may change over time. The objective is to dynamically repartition the n nodes into ` clusters, each of size k. Every communication request needs to be served either locally (cost 0), if the communicating nodes are collocated in the same cluster, or remotely (cost 1), using intercluster communication, if they are located in different clusters. The algorithm can also dynamically update the partitioning by migrating nodes between clusters at cost α per node migration. Therefore, we are interested in online algorithms which find a good tradeoff between the communication cost and the migration cost, maintaining partitions which minimize the number of inter-cluster communications. We consider settings both with and without cluster-size augmentation. For the former, we prove a lower bound which is strictly larger than k, which highlights an interesting difference to online paging. Somewhat surprisingly, and unlike online paging, we prove that any deterministic online algorithm has a non-constant competitive ratio of at least k, even with augmentation. Our main technical contribution is an O(k log k)-competitive algorithm for the setting with (constant) augmentation. We believe that our model finds interesting applications, e.g., in the context of datacenters, where virtual machines need to be dynamically embedded on a set of (multi-core) servers, and where machines migrations are possible, but costly.
منابع مشابه
Graph Repartitioning with both Dynamic Load and Dynamic Processor Allocation
Dynamic load balancing is an important step conditioning the performance of parallel programs, like adaptive mesh refinement codes. If the global workload varies drastically over time (such that memory is exceeded), it can be relevant to adjust the number of processors while maintaining the load balanced. We propose two different solutions, that extend classic graph repartitioning approaches to...
متن کاملA repartitioning hypergraph model for dynamic load balancing
In parallel adaptive applications, the computational structure of the applications changes over time, leading to load imbalances even though the initial load distributions were balanced. To restore balance and to keep communication volume low in further iterations of the applications, dynamic load balancing (repartitioning) of the changed computational structure is required. Repartitioning diff...
متن کاملThe Dynamic Adaptation of Parallel Mesh-Based Computation
We present an overview of algorithms and data structures for dynamic re nement/coarsening (adaptation) of unstructured FE meshes on loosely coupled parallel processors. We describe a) a parallel adaptation algorithm, b) an online parallel repartitioning algorithm based on mesh adaptation histories, c) an algorithm for the migration of mesh elements between processors, and d) an integrated objec...
متن کاملScalable and Adaptive Online Joins
Scalable join processing in a parallel shared-nothing environment requires a partitioning policy that evenly distributes the processing load while minimizing the size of state maintained and number of messages communicated. Previous research proposes static partitioning schemes that require statistics beforehand. In an online or streaming environment in which no statistics about the workload ar...
متن کاملWorkload-aware incremental repartitioning of shared-nothing distributed databases for scalable OLTP applications
On-line Transaction Processing (OLTP) applications often rely on shared-nothing distributed databases that can sustain rapid growth in data volume. Distributed transactions (DTs) that involve data tuples from multiple geo-distributed servers can adversely impact the performance of such databases, especially when the transactions are short-lived and these require immediate responses. The k-way m...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2016